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We continue our numerical study of quantum belief propagation initiated in [15] . We demonstrate 
how the method can be expressed in terms of an effective thermal potential that materializes when 
the system presents quantum correlations, but is insensitive to classical correlations. The thermal 
potential provides an efficient means to assess the precision of belief propagation on graphs with no 
loops. We illustrate these concepts using the one-dimensional quantum fsing model and compare 
our results with exact solutions. We also use the method to study the transverse field quantum Ising 
spin glass for which we obtain a phase diagram that is largely in agreement with the one obtained in 
[llj using a different approach. Finally, we introduce the coarse grained belief propagation (CGBP) 
algorithm to improve belief propagation at low temperatures. This method combines the reliability 
of belief propagation at high temperatures with the ability of entanglement renormalization to 
efficiently describe low energy subspaces of quantum systems with local interactions. With CGBP, 
thermodynamic properties of quantum systems can be calculated with a high degree of accuracy at 
all temperatures. 

PACS numbers: 05.30.-d, 02.70.-c, 05.50.+q, 75.50.Lk 



I. INTRODUCTION 

The most interesting phenomena in condensed matter 
physics occur when a large number of quantum particles 
are put into interaction. However, even the most simpli- 
fied models of these interactions rarely admit analytical 
solutions. For this reason, numerical methods must be 
called into play. As direct numerical simulations require 
resources that scale exponentially with the number of 
particles, approximation schemes are needed to under- 
stand these systems at their thermodynamic limit. 

Starting with White's density matrix renormalization 
group (DMRG) method 24J, families of states have been 
introduced that accurately describe the low energy sector 
of locally interacting quantum systems using few param- 
eters [U H3 US]- In particular, matrix product states 
(MPS) approximate ground states of one-dimensional 
gapped Hamiltonians [7J [TB], and projected entangled 
pair states (PEPS) are accurate in higher dimensions at 
finite temperature [UH]. 

Even though these states require few parameters, find- 
ing the right set of parameters for a given system remains 
a formidable task [TB]. Only in special cases, such as 
simulating imaginary time evolution within a variational 
set of states |21j . or using iterative minimization proce- 
dures [T7J, have successful heuristics been devised that 
solve this problem. 

In this article, we introduce coarse grained belief propa- 
gation (CGBP), which combines the strength of two such 
heuristics. The first method, devised by Vidal, is a refine- 
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ment of real space renormalization |25j called entangle- 
ment renormalization (ER) [5] [5D] . The strength of this 
method comes from the realization that entanglement is 
organized on different length-scales in the ground state 
of many systems of interest, including critical systems 
[H [201 H2 and systems with topological order [2J ITU] , 
As a consequence of this organization, entanglement can 
be efficiently removed from the state by a sequence of 
local coarse-graining transformations. This leads to a 
very efficient scheme for finding low-energy states of lo- 
cal Hamiltonians, making ER a very effective method for 
low temperatures. 

The second method is belief propagation (BP), which is 
a well studied and widely used method to solve inference 
problems involving a large number of correlated random 
variables (see e.g. [3] HH [SB]). This algorithm is exact 
on trees where it essentially reduces to a transfer matrix 
solution. On more general graphs, it can be described 
as performing a constrained minimization of the Bcthc 
free energy of the system [55]. Therefore, it is often a 
very good approximation on graphs containing no small 
loops. On graphs with small loops, generalizations of BP 
can also provide reliable approximations [2"51 |2"B] . 

Belief propagation was recently generalized to quan- 
tum theory by us and others [S [TU H2 ES] ■ The gist of 
the method consists of solving the system exactly on a 
small cluster and using this solution to compute effective 
thermal Hamiltonians on the neighboring clusters. This 
procedure is repeated iteratively until it produces a cor- 
rection to the bare Hamiltonian that accurately mimics 
a system of infinite size. The method is very accurate at 
high temperatures and on trees or graphs with only large 
loops [15]. However, BP becomes unreliable at low tem- 
peratures because the clusters must be larger or equal to 
the range of the effective Hamiltonian, which grows like 
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the inverse of the temperature. 

Coarse grained belief propagation combines the fea- 
tures of BP and ER. Starting at high temperatures where 
plain BP is accurate, temperature is lowered until coarse- 
graining the lattice by eliminating its shortest length- 
scale degrees of freedom becomes favorable. Coarse 
graining discards some high energy states, which results 
in a systematic error in the thermal state. On the other 
hand, it increases the effective size of the clusters, mak- 
ing BP more accurate. The coarse-graining procedure is 
continued as temperature is lowered to zero where plain 
ER is accurate. An estimate of the error caused by BP 
can be used to determine the temperatures at which each 
coarse-graining procedure should be performed. 

In Sec. [n] we review the BP method and describe 
how to estimate its accuracy. Based on this technique, 
Sec. |III| presents results obtained for the transverse field 
quantum Ising spin glass studied in [TTJ. Finally, in Sec 
IV we introduce the CGBP algorithm, and benchmark it 
using an infinite quantum Ising chain. 
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mo^i(xi) = 1, we see that Z(f3) = m N ^i^ N (x N ). 

This procedure can be generalized to arbitrary graphs 
by defining the update rule for the message rrii^j(xj), 
passed from site i to a neighboring site j, to be 
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are equal to the reduced one- and two-body distribution 
respectively and the partition function can be evaluated 
from any one of their normalization. When the underly- 
ing graph contains loops, BP is no longer exact but often 
provides accurate approximation to the true marginal 
states and partition function. 



II. BELIEF PROPAGATION 

A. Classical setting 

Consider a system composed of N classical spins 
on a chain with Hamiltonian H{x\,...,xn) — 
"YliU j\h{xj,Xj), where denotes neighboring sites. 

The partition function for this system is defined as 

Z{0) = e- 0H(xi '-' x ^ (1) 

X\ ,....xn 

= e -/3'iiv,N-i _ e -/3/i 3 ,2 e -/3'i2,i (2) 

X\ ,...,xn 

where we use the shorthand hij = h(xi,Xj). A brute 
force calculation of this quantity requires summing over 
an exponential (in TV) number of terms. However, taking 
advantage of the local structure of the Hamiltonian, the 
sum can be rearranged as follows: 
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Now, the sums can be performed sequentially with 
each sum only involving a small number of terms 1 , al- 
lowing the computation of Z in a time proportional 
to N. This leads to an iterative rule where messages 
rrii^j are exchanged along the edge of the chain connect- 
ing two sites i,j with the update rule mi^i+\{xi+\) — 



The procedure we are describing for a chain is usually referred 
to as the transfer matrix method in statistical physics. 



B. Quantum setting 

Consider now the quantum case H = ^2u j) where 
hij are Hermitian operators acting on site i and j of a 
chain. Defining the ©-product between positive opera- 
tors A B = e lo s( A )+ lo g( s ) 5 we can write the partition 
function in a form very similar to Eq. Q 

Z{0) = Tr(e-^) (4) 
= Tr{e- l3hN - N - 1 . . . e- 0113 - 2 e' 0112 - 1 ) (5) 

with the sums replaced by traces and products by 0- 
products. This expression cannot be reorganized like its 
classical counterpart bccausc-unlikc ordinary products- 
the 0-product does not obey a distributive law in the 
sense that Tr Q ( e - /3 ' 1 - ! '0e- /3 ' li '. c ') ^ e"' 3 ' l '=' b 0Tr a (e-' 3 ' lb -). 

However, the distributive law holds when the chain 
forms a quantum Markov network |12j . i.e. I (a : c\b) = 
where the quantity I(a : c\b) — S(a, c) + 5(6, c) — S(b) — 
S(a, b, c) is known as the conditional mutual informa- 
tion and S is the von Neumann entropy. Intuitively, this 
condition means that all correlations between a and c 
are mediated through b. This does not prevent a and 
c from being correlated, but implies that all informa- 
tion learned about a by measuring c can equivalcntly be 
obtained by measuring b instead. While this condition 
does not hold for generic quantum interactions, it be- 
comes approximately true when the "Markov shield" b is 
sufficiently thick. 

To understand this behavior physically, consider again 
a one-dimensional chain with nearest neighbor interac- 
tions H — J2i hi,i+i- The thermal Gibbs state at inverse 
temperature j3 is given by p — e~@ H / Z({3). The reduced 
state of spins 2,3, ... ,N is obtained by tracing out the 
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FIG. 1: (Color online) Upper bound on ||V^f ff || {left) and cor- 
relations (right) of the Ising chain with critical transverse 
field. These exact values are obtained from a Jordan- Wigner 
transform. Note that ||V^|| decays much faster than the cor- 
relations (notice the different length-scales). The values for 
/3 = 10 are in a different color as an aid to the eye. 



— iLog(/92,...jv) where Log is the principal matrix log- 
arithm. Similar effective Hamiltonians have also been 
studied in [27] in the context of reduced density matrices 
of fermionic and bosonic ground states. We also define 
the effective thermal potential V = H e g — J^—j 1 ^m+i 
as the term added to the bare Hamiltonian on sites 2 to 
N due to the presence of site 1. 

At high temperatures, the effective thermal potential is 
short ranged. Consider for instance the one-dimensional 
Ising model with transverse field on an infinite chain 
H = J2iL^ 00 <T i cr i+i + B a i- At zero temperature, this 
model exhibits a phase transition at the critical trans- 
verse field value B = 1. Fig. [l] shows the value of the 
effective potential V e g = —^ogTr^ oo ^ t0 (e~ l3H ) — H h!iTe 
obtained from cutting the critical Ising chain in half, i.e. 
tracing out spins — oo to from the thermal state of 
an infinite chain. What is plotted is (an upper bound 
to) the operator norm of the cumulants of V c q: = 

Tr J+ i,...,oo(K ff - EfclKff) with V ef£ = Tr 2 ,...,oo(Kff). 
We see that V e g has a very short range, in fact much 
shorter than the correlation length in the system. 



first spin of the chain, i.e. P2,...,n — Tri(p). We can for- 
mally define the effective thermal Hamiltonian H b q act- 
ing on sites 2, . . . , N up to normalization by 

P2,...,n = e-? H °«. (6) 
In other words, H c ff is the traceless part of 



The distributive law becomes approximately true when 
the distance between the traced-out site and the end 
of the cluster is sufficiently large to support the effec- 
tive thermal potential. Thus, we can reorganize the sum 
of Eq. (D as in the classical case, but keeping an ^-site 
Markov blanket between the traced-out site and the end 
of the cluster: 
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~ IV.', v (e _/3 ' liv ~ 1 - JV ... e - phl + 2 > l + 3 Tr 2 (e 

« TtN-i,...,N (e-P hN -^ © mjv-i^w) 



where we have defined m^i + i = Tri_; + i(e _/3 ' li ' i + 1 
m i _ 1 ^ i ), which is an operator acting on sites i — I + 2 
to i + 1 (see Fig. [2j. These equations require manipu- 
lating operators on up to I + 1 spins, so their complexity 
increases exponentially with the window size I. 

Like in the classical setting Eq. ^ , these message pass- 
ing rules can be generalized to arbitrary graphs, enabling 
the computation of one- and two-body beliefs from which 
various quantities of interest such as energy can be com- 
puted. The method can also be adapted to estimate all 
correlation functions. 

Because of computational limitations, the effective 
thermal potential V c g cannot be computed exactly. In- 
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* J + 1 0...0e- fc )) (8) 
0h l+ i,i +2 m ^ i+1 )) ( 9 ) 

(10) 

(11) 

I 

stead, we can only estimate its value on a cluster of finite 
size. Thus, the main source of error in our method is 
due to the truncation of V e g . We can assess the error by 
evaluating the portion of V c r we discard. On a chain for 
instance, the error caused on the estimate of the beliefs 
is 

1 (e -W._ e -«^ >1 i4) ) „ J2(V^) (12) 
{P! j>l 

for PV^ S <C 1. Making the assumption (see Fig. [l| that 
||Vlff|| decreases exponentially with j, we estimate this 
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FIG. 2: Calculating from 013^4 in an iteration of BP 

algorithm with I — 4. In the first step e h4,5 is added to 
m,3^4 using the ©-product. Then, the first spin is traced out 
yielding 1714^5. 
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FIG. 3: Error on the energy density as a function of temper- 
ature for the critical Ising chain. For QBP with window size 
I — 10, we show the error estimate of Eq. ( |13[ ) and the true 
error obtained by comparison with analytical solution. Also 
shown is the finite size error for exact diagonalization of a 11- 
site chain and error caused by iTEDB \2 F with parameters 
ST — 0.001 and x = 150, both of which require equivalent 
computational resources. 



quantity by 

ftVg 1 ) n /3(V&) (J^^J (13) 

which is our final error estimate. With the same reason- 
ing, similar estimates can be derived for the error asso- 
ciated with different observables. 

Fig. [3] compares this error estimate to the true error 
produced by BP for the evaluation of the energy density 
of the critical one-dimensional Ising chain. Clearly, the 
error estimate accurately bounds the true error. This 
figure also illustrates the power of BP by comparing the 
accuracy with which BP estimates the energy density of 
an infinite chain to what is achieved by brute force di- 
agonalization with equivalent computational resources. 
BP largely outperforms diagonalization down to temper- 
atures of order 0.1. This behavior is expected because, 
as seen on Fig. [I] (red line), the range of the effective 
thermal potential becomes larger than the window size 
(I = 10) at this temperature. 



III. DISORDERED SYSTEM REVISITED 

The use of belief propagation in physics originates in 
the study of disordered systems-spin glasses-where it is 
more often referred to as the "cavity method" [13] . Along 
with the sliding window algorithm outlined in the previ- 
ous section, we presented in [THE3 a second distinct way 
to generalize BP to the quantum setting. This method, 
which we named "replica BP" , maps the quantum system 
to a classical system with one additional spatial dimen- 
sion of length equal to the inverse temperature [3. The 
edges of a graph become ribbons on which classical BP 
can be employed for sufficiently low /3. This technique 
was independently introduced by Laumann et al. |llj 
for the study of the transverse field quantum Ising spin 
glass. The continuous imaginary-time limit of this pro- 
cedure was later studied in [28] . 

The numerical results obtained in [15] suggest that, 
for a given amount of computational power, sliding win- 
dow BP is much more accurate than replica BP. In this 
section, we revisit the spin-glass model of [TT] using slid- 
ing window BP, and apply the method outlined in the 
previous section to estimate the accuracy of our results. 

The spins are located at the vertices of a degree-3 Cay- 
ley tree. The Hamiltonian has Ising coupling between 
neighboring spins and a transverse field B: 

ff=E°? o i +B E°f + E ( 14 ) 

i iGBoundary 

The last term is a random parallel boundary field intro- 
duced to create frustration in the system. The strength 
of the boundary fields are chosen at random uniformly 
in [—1,1]. The quantity of interest in this setting is the 
Edwards- Anderson order parameter qea = (X^( ct J) 2 )q 
on the lattice at the thermodynamic limit, where (-)q 
refers to the quench average over the random boundary 
field configurations. Note that this order parameter is 
defined along the axis perpendicular to the applied ex- 
ternal field B, but parallel to the random boundary field. 
Hence, qea is zero in the paramagnetic phase. It be- 
comes non-zero on the onset of the glassy phase where 
the system settles into one of many meta-stable randomly 
polarized state. 

Our numerical simulations are performed on a tree of 
depth 12. To further reduce the finite-size effects, the 
EA order parameter is only evaluated on the central spin 
of the lattice, away from the boundary. The order pa- 
rameter can be computed from the single-body belief bj 
obtained from BP. On a chain, we would start from one 
end and propagate messages to the other end of the chain. 
On the tree, we start from the leaves, and propagate 
messages towards the middle. The basic message pass- 
ing step is demonstrated in Fig. [4] First, two messages 
from the children of a given node are combined using 
the ©-product . The bare Hamiltonian term relating the 
node to its parent is then added. Tracing out the leaves 
of this 8-spin message gives the message to the node's 
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FIG. 4: Schematic illustration of the procedure to calculate the message from a node to its parent. First, two messages from 
its children are merged using the ©-product . The bare hamiltonian term relating the current node to its parent is also added. 
Tracing out the leaves of this 8-spin message gives the message to the node's parent. 



parent. This procedure is repeated until the central site 
is reached where three messages are joined to produce 
the belief. The quench average is obtained by repeating 
this procedure 100 times with different boundary field 
configurations. 

Because the graph contains no loops, the error esti- 
mate presented in the previous section is reliable. How- 
ever, note that the statistical fluctuations of the quench 
average are not included in this error estimate. The sta- 
tistical fluctuations of the average of qEA over the many 
instances of boundary fields range from 2 percent at low 
temperatures to 14 percent at high temperatures. There- 
fore, the main source of error in parts of Fig. [5]is the sta- 
tistical fluctuations which are not shown in the plot, and 
can be systematically reduced by increasing the sample 
size. 

Fig [5] shows the EA order parameter (?ea in the trans- 
verse field-temperature diagram, along with the esti- 
mated BP error. The glassy /paramagnetic phase tran- 
sition line agrees with results of [IT] up to the statis- 
tical fluctuations above T > 0.3. At low temperatures 
(T < 0.3), our results indicate a phase transition line 
with a decreasing value of B as T is lowered. We could 
not think of any physical mechanism that could explain 
this behavior. Moreover, this happens in a region of the 
phase diagram where the BP error is high. Hence, we sus- 
pect that the true phase transition line has a monotonous 
behavior in temperature and that the glassy phase per- 
sists all the way to zero temperature for a transverse field 
B < 1.65. This conclusion and, more generally, our en- 
tire phase diagram is in very good agreement with that 

of [EE]. 



IV. COARSE GRAINED BELIEF 
PROPAGATION 

We have seen that BP provides reliable estimates 
of thermal expectation values as long as the effective 
thermal potential V c s is sufficiently short ranged to be 
tracked numerically. As seen e.g. in Fig. [TJ the range 
of V e ff grows linearly with (3, so BP becomes unreliable 
at low temperatures. To probe lower temperatures, one 
needs to increase the window size which is not fea- 
sible because resources scale as 0(2 l ). On the other 
hand, as we lower the temperature, high energy exci- 
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FIG. 5: The Edwards- Anderson order parameter for trans- 
verse field quantum Ising spin glass on a degree-3 Cayley tree 
with random parallel boundary fields. The total depth of the 
tree is 12, and the plots show the average of 100 instances of 
random boundary fields. Values of qea range from to 1 and 
contours are equally spaced. The error on the order param- 
eter is estimated using the procedure outlined at the end of 

Sec. urn 

tations become increasingly irrelevant. This fact leads 
to efficient algorithms for zero temperature simulations 
such as entanglement rcnormalization and DMRG. These 
algorithms become rapidly inaccurate at finite tempera- 
ture because they are only able to keep track of a small 
number of eigenstates. In this section, we will describe a 
method that interpolates between BP at high T to ER at 
T = 0. Before we do so, we briefly review ER, see [51 [2Uj 
for a detailed description. 



A. Entanglement renormalization 

Entanglement renormalization [5j [20] builds on the 
multi-scale renormalization ansatz (MERA) which as- 
serts that certain degrees of freedom can be decoupled 
from the ground state of local Hamiltonians by unitary 
transformations acting on small spatial regions. A con- 
crete example of this scheme is illustrated in Fig.[6]in the 
case of a one dimensional lattice. The lattice is first parti- 
tioned into clusters each containing 3 consecutive sites. A 
disentangling transformation u [a unitary transformation 
on (C x )® 2 ] is applied on the boundary of each cluster in 
order to minimize the correlations between neighboring 
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FIG. 6: Schematics of entanglement renormalization for a 
ternary MERA of a one dimensional lattice. 

clusters. Finally, local degrees of freedom are discarded 
from each cluster by means of an isometry 2 v mapping 
(C x )® 3 to C x . 

This procedure is applied repeatedly. At each iter- 
ation, the disentanglers and isometries transform the 
Hamiltonian Hi to a new Hamiltonian Hi + \ acting on a 
smaller lattice and retaining only the lowest cigcnstatcs 
of the previous Hamiltonian. ER is halted when only a 
few sites remain in the lattice so it can be handled exactly 
numerically. The disentanglers and isometries are chosen 
in such a way that the final state (or more generally sub- 
space) minimizes the energy of the initial Hamiltonian 
Hq. This minimization problem is in general hard, but 
good heuristics have been devised for it [20] . 



B. The interpolated scheme: CGBP 

Both ER and BP revolve around the idea that some 
correlations are short range in the state of interest. BP 
becomes exact when the conditional mutual information 
/( [— oo, j] : \j + l,oo]\[j + l,j + l — l]) vanishes for a suffi- 
ciently large window size I. In other words, BP can work 
in the presence of arbitrary long range classical correla- 
tions but the purely quantum correlations must be short 
ranged. These quantum correlations tend to increase like 
the inverse temperature (3 (c.f. Fig. [IJ, which limits BP 
to relatively high temperatures, unless the window size I 
can somehow be increased while keeping computational 
cost low. In contrast, ER makes use of disentanglers to 
eliminate short-range quantum correlations in the system 
and coarse grain the lattice. Because it only keeps a few 
low-energy states, it is limited to very low temperatures. 

Coarse grained belief propagation interpolates between 
these two methods and provides accurate thermal expec- 
tation values over a very large range of temperatures. At 
high temperature, CGBP reduces to ordinary BP. As the 
temperature is lowered, the error attributed to BP in- 
creases. At some temperature T 1; it becomes favorable 
to coarse grain the lattice using one step of ER. This pro- 



2 At the first iteration of ER, the disentangler would be a unitary 
transformation on (C d )® 2 and the isometry would map (C 1 )® 3 
to C d where d is the number of levels of the particles forming the 
lattice. 




FIG. 7: (Color online) Energy vs temperature for the one di- 
mensional critical quantum Ising model. Presented are the 
plain BP results for Z = 10 [dark blue), CGBP results for 
various levels of coarse graining with \ = 4 and 1 = 5 (var- 
ious colors), the plain ER result X = 4 (light green) along 
with the exact result obtained from Jordan- Wigner transfor- 
mations (black). The labels on the temperature axis corre- 
spond to the switching temperatures between various levels 
of coarse graining in the CGBP algorithm. E.g., plain BP is 
very accurate down to T\ « 0.22, where BP combined with 
one level of coarse graining (red) becomes more accurate. The 
inset shows the absolute error in the combined CGBP result 
with respect to the exact solution (blue), and the error esti- 
mate calculated using the procedure given in Sec. |IV B| While 
plain BP and plain ER are both very inaccurate for tempera- 
ture range 0.005 < T < 0.22, combining the two using CGBP 
yields very accurate results. 



cedure discards some high energy states, leading to a sys- 
tematic error, but it effectively increases the BP window 
length I by a constant factor (3 in the ternary ER scheme 
illustrated in Fig. |6j. This increase in the window length 
improves the accuracy of BP and compensates for the loss 
of high energy states. As the temperature is lowered, the 
lattice is further coarse grained at Ti, T3, ... until the 
CGBP reduces to ordinary ER. Fig. [7] illustrates this 
behavior for the one dimensional critical quantum Ising 
model. Each coarse graining level provides a reliable esti- 
mate only for a small temperature range, but the union of 
these ranges cover the entire temperature domain. Thus, 
CGBP provides accurate estimates of thermodynamical 
observables in temperature ranges that are accessible to 
neither BP nor ER. 

To calculate the optimal coarse-graining temperatures 
Ti, we would need independent error assessments for ER 
and BP. Then, we could switch to a coarser lattice when- 
ever the increase in window size compensates for the 
coarse graining of the Hamiltonian. However, we are not 
aware of a reliable method to estimate the error caused 
by ER. Instead of using error estimates, we simultane- 
ously perform BP on two different coarse grained levels 
and determine the switching temperatures by comparing 
the results. 

More precisely, let Xi(T) be the expectation value of 
some observable X at temperatue T obtained by BP on 
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the i th level of coarse graining. To determine the switch- 
ing temperature Ti + i from the i th level of coarse graining 
to the (i+1)*' 1 , we calculate both xi and x i+ \ as we slowly 
lower the temperature. At high temperatures, the dom- 
inating error is attributed to the discarded high energy 
states, so a?{ is more accurate than x~i+\. On the other 
hand, at low temperatures, as the range of the effective 
thermal potential gets larger than the BP window, 5fj_|_i 
becomes more accurate than . The two sources of er- 
rors are balanced when \xi — reaches a minimum 
(see Fig. [8]), so Tj should be chosen at the position of 
this minimum. There can be exceptions to this rule that 
result from accidental crossings of and x». In that 
case, the error estimate for BP presented in Sec. |IIB| 
can be used to discriminate between the multiple min- 
ima. Indeed, the switching should occur when the value 
of \xi — 5?j+i| is the closest to the error attributed to BP 
on the i th level because both numbers are estimates of 
the BP error. The switching temperatures for Fig. [7] were 
chosen following this method. 

We can use the same reasoning to estimate the total 
error Sx(t) on our final estimate x(T) obtained by joining 
the Xi(T) over their respective range. We define Sxf p (T) 
to be the error attributed to BP on the i th level of coarse 
grain ing. This quantity can be estimated as described in 
Sec. " 
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II B 



For T > Ti, we have Sx(T) = Sx$ p (T) since 
BP is the only source of error. Between T\ and T2, there 
are two contributions to the error: the error Sxf p (T) 
attributed to BP on the 1 st coarse grained level and the 
error attributed to ER caused by discarding high energy 
states. This second error decreases as temperature is 
lowered, and at T = T\ it is equal to the BP error (this 
is how Ti was defined). Thus, we obtain for T 2 <T < Ti 
the bound Sx(T) < Sxq P (Ti ) + Sxf p (T) . More generally, 
for T l+1 < T < T, we get Sx(T) < Sxf^Tj) + 

Sxf p (T). See the inset of Fig. |7]for the error estimate of 
CGBP with x = 4 and I = 5. 

In addition to CGBP with x = 4 and I — 5, we have 
also investigated various other combinations of \ an d I- 
At equal computational costs — which are of 0(x 31 ) — the 
results are qualitatively equivalent in the sense that they 
have roughly equivalent maximum error. However, vary- 
ing x and I at fixed computational cost can improve the 
results for a given temperature. For instance, at very low 
temperatures, the computations with a higher x yield re- 
sults with better accuracy. On the other hand, larger 
I and smaller x perform better at high temperatures. 
Thus, the values of x an d / could also be varied dynam- 
ically in the simulation, but we leave out this possibility 
for the moment. 

The results we obtain with CGBP compare favorably 
with results obtained by other methods using equivalent 
computational resources. This can be seen by compar- 
ing the inset of Fig. [7] to the various curves shown on 
Fig. [3] The CGBP result with x = 4, I = 5 has at least 
four digits of accuracy for the entire temperature range. 
The complexity of this simulation is equivalent to exact 
diagonalization of a 11-site chain, that produces a re- 
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FIG. 8: The exact error in the energies calculated at the first 
and second levels of coarse graining, \Ei — E exac t\ and — 
E exac t\ are plotted along with \E 1 — E2[- Note that for both 
\Ei — E exac t \ and \E2 — E exac t\, MERA error dominates at high 
temperatures, and BP error dominates at low temperatures. 
The minimum of their difference \E\ — E-z\ occurs when the 
BP error at level 1 of coarse graining is equal to the MERA 
error at level 2 of coarse graining. Furthermore, the high 
temperature portion of \E\ — Ei\ is dominated by the MERA 
error at level 2 and the low temperature portion of \E\ — Ei\ 
is dominated by the BP error at level 1. 



suit accurate to roughly three digits. Many methods rely 
on a Trotter-Suzuki decomposition by discretizing imag- 
inary time in intervals ST, which creates a systematic 
bias 0(5T 3 ) in the result. This is the case for instance 
of imaginary time dependent block decimation |21j . This 
algorithm has complexity (xd 2 ) 3 T m i n /5T where d = 2 
for the Ising model is the dimension of the spins. The 
parameters x = 150 and ST — 0.001 yield the same com- 
plexity as the x = 4 / = 5 CGBP algorithm, and produce 
an error of roughly 10 -2 at sufficiently low temperatures. 



V. DISCUSSION 

The concept of an effective thermal potential, obtained 
by tracing out sites from the thermal Gibbs state, gives 
a clear physical picture of the workings of belief prop- 
agation. Adding a site to a spin chain can modify the 
thermal state even far away from the added site, as far 
as the correlation length of the system. However, this 
effect can be mimicked by adding a short range thermal 
potential to the Hamiltonian of the original spin chain. 
At finite temperature, we have seen that the range of 
this thermal potential can be much shorter than the cor- 
relation length of the system, making it more suitable 
for numerical simulations. This underlies the success of 
belief propagation and provides a means to assess its ac- 
curacy. We have illustrated these concepts and methods 
on the critical quantum Ising chain and the transverse 
field quantum Ising spin glass. For this last system, our 
findings are, within estimated error bars, in agreement 
with those of [TT] obtained from a different belief propa- 
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gation implementation. 

At lower temperatures however, the range of the effec- 
tive thermal potential becomes too large to handle nu- 
merically. For these temperature ranges, we have intro- 
duced the coarse grained belief propagation algorithm by 
combining belief propagation with entanglement renor- 
malization. Coarse graining discards some high-energy 
states, which leads to a systematic error in the thermal 
states. On the other hand, it increases the accuracy of 
BP by shortening the range of the effective thermal po- 
tential by a constant factor. CGBP seeks an optimal 
compromise between these two effects in order to accu- 
rately probe temperature regimes where neither ER nor 
BP are reliable. Thus, CGBP truly extends the domain 
of applicability of the two underlying approaches. More- 
over, results obtained by CGBP compare favorably to 
other methods using equivalent computational resources. 

The drawback of CGBP is that it inherits some in- 
trinsic limitations of the underlying approaches. For 
instance, ER is applicable only when there exists a 
coarse graining method which preserves the locality of 
the Hamiltonian. For graphs with exponential spreading 



structure, such as the Cayley tree studied in Sec. |III| we 
are not aware of such coarse graining procedures. This 
is the reason we have not implemented CGBP on that 
system. Another limitation comes from the shortcoming 
of BP on graphs containing many small loops such as 
two-dimensional lattices. Classically, this limitation can 
be alleviated using generalized BP . We are cur- 

rently working on combining such generalizations with 
ER to study lattices of higher dimension. 



VI. ACKNOWLEDGEMENTS 

Computational resources were provided by the Reseau 
quebecois de calcul de haute performance (RQCHP). DP 
receives financial support from Canada's NSERC and 
le Fonds quebecois de la recherche sur la nature et les 
technologies. EB is supported by DoE under Grant No. 
DE-FG03-92-ER40701, and NSF under Grant No. PHY- 
0803371. 



[1] I. Affleck, T. Kennedy, E. Lieb, and H. Tasaki, 

Commun. Math. Phys., 115, 477 (1988). 
[2] M. Aguado and G. Vidal, Phys. Rev. Lett., 10, 070404 

(2008). 

[3] S. Aji and R. McEliece, IEEE Trans. Info. Theory, 

46, 325 (2000). 
[4] L. Cincio, J. Dziarmaga, AND M. M. Rams, Phys. 

Rev. Lett., 100, 240603 (2008). 
[5] G. Evenbly and G. Vidal, Phys. Rev. B, 79, 144108 

(2008). 

[6] M. B. Hastings, Phys. Rev. B, 73, 085115 (2006). 
[7] M. B. Hastings, J. Stat. Mech., P08024 (2007). 
[8] M. B. Hastings, Phys. Rev. B, 76, 035114 (2007). 
[9] M. B. Hastings, Phys. Rev. B, 76 201102(R) (2007). 
[10] R. Konig, B. Reichardt, and G. Vidal, Phys. Rev. 

B, 79, 195123 (2009). 
[11] C. Laumann, A. Scardicchio, and S. Sondhi, Phys. 

Rev. B, 78, 134424 (2008). 
[12] M. Leifer and D. Poulin, Ann. Phys., 323, 1899 
(2008). 

[13] M. Mezard and G Parisi, The European Physical 

Journal B, 20, 217 (2001). 
[14] J. Pearl, Probabilistic reasoning in intelligent systems: 

networks of plausible inference, (Morgan Kaufmann, 

1988). 

[15] D. Poulin and E. Bilgin, Phys. Rev. A, 77 052318 
(2008). 

[16] N. Schuch, J. I. Cirac, and F. Verstraete, Phys. 

Rev. Lett., 100, 250501 (2008). 
[17] F. Verstraete and J. I. Cirac, 2004, e-print cond- 

mat/0407066. 

[18] F. Verstraete and J. I. Cirac, Phys. Rev. B, 73, 

094423 (2006). 
[19] G. Vidal, Phys. Rev. Lett., 91, 147902 (2003). 
[20] G. Vidal, Phys. Rev. Lett., 99, 220405 (2007). 



[21] G Vidal, Phys. Rev. Lett., 98, 070201 (2007). 

[22] G Vidal, Phys. Rev. Lett., 101, 110501 (2008). 

[23] M. J. Wainwright, T. S. Jaakkola, and A. S. Will- 
sky, IEEE Trans. Info. Theor., 49, 1120 (2003). 

[24] S. R. White, Phys. Rev. Lett., 69, 2863 (1992). 

[25] K. G. Wilson, Rev. Mod. Phys., 47, 773 (1975). 

[26] J. S. Yedidia, W. T. Freeman, and Y. Weiss, Under- 
standing belief propagation and its generalizations, Tech. 
Rep. TR-2001-22, Mitsubishi Electric Reasearch Labora- 
tories, 2002, pp. 239-236. 

[27] I. Peschel, V. Eisler, 2009, e-print cond- 
mat/0906.1663. 

[28] F. Krzakala, A. Rosso, G. Semerjian and F. Zam- 
poni, Phys. Rev. B, 78, 134428 (2008). 



